Mixed and Augmented Reality Innovations in Beijing Institute of Technology

Introductions are given to key technologies of various Mixed and Augmented Reality systems developed and realized at Beijing Institute of Technology. The automatic calibration method for the multi-projector systems is studied and a new constrained color-matching algorithm has been investigated to remove the color variations. The optical see-through head-mounted display (OST-HMD) utilizing an ultra-light wide-angle eyepiece is designed and a fast recalibration method based on an equivalent camera model is presented. The passive haptics is applied in a mixed reality system and the perception consistency of visual and tactile information has been explored. To interact with the augmented reality system more intuitively, a hand detection method and a gesture recognition algorithm has been developed. An experimental teaching system has been developed which integrates the AR technology, gesture interactions with the video mediated collaboration in an effort to enhance the skill learning among spatially distributed users.